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(54) Inspection device 

(57) Inspection device containing means to spec- 
trally split up reflected light or transmitted light, an 
image recorder (2) coupled thereto and a processor (3) 
connected to the image recorder (2) for processing its 
signals, characterized in that the image recorder (2) is 
of the type which can read out lines or parts of lines sep- 
arately. 




< 

o 
o> 

o> 

o> 
o 

Q. 

LU 

Printed by Xorot (UK) Business Serviooo 
2.16.7/3.6 

06/20/2003, EAST Version: 1.04.0000 



1 



EP0949490A1 



2 



Description 

[0001] The present invention concerns an inspection 
device containing means to spectrally split up reflected 
light or light which has been transmitted through an 5 
object, an image recorder coupled thereto and a proc- 
essor connected to the image recorder for processing 
its signals. 

[0002] Such inspection devices make use of the char- 
acteristic that every material has its own spectral signa- 10 
ture, i.e. a specific alteration of the reflected or 
transmitted irradiation through the object as a function 
of the wave length. By comparing the reflectance or 
transmission, it is possible to distinguish materials from 
one another. For a number of typical wave lengths, the 75 
difference in reflectance will be relatively large. One 
only has to compare the reflectance or transmission for 
one or several of these wave lengths. 
[0003] Also, the above-mentioned inspection devices 
are already used in the industrial sector to inspect 20 
objects or to detect for example foreign substances in a 
material. 

[0004] They contain a spectrometer, consisting of an 
imaging spectrograph which spectrally splits up or 
decomposes the light which is reflected by a strip of an 25 
object or which is transmitted on the one hand, and of a 
usually monochrome CCD camera as an image 
recorder or imager which is connected to the processing 
unit or processor. 

[0005] Such device is disclosed by HERRALA E. et al. 30 
in "Imaging spectrometer for process industry applica- 
tions", PROCEEEDINGS OF THE SPIE, vol 2248, 20 
June 1994, p.33-40. 

[0006] The spectrograph splits up the image of the 
strip in images of different wave lengths, so that the 35 
resulting image which is recorded by the CCD camera 
consists of a number of images of the strip situated next 
to one another, each time for a different wave length. 
[0007] The entire image of this CCD camera and thus 
the images for all the wavelengths are read, but since 40 
only one or a restricted number of typical wave lengths 
can or have to be compared, the images corresponding 
to these typical wave lengths are used by the processor. 
[0008] The reading out of the entire image which has 
been recorded by the CCD camera is relatively time- 45 
consuming, however, and this camera is the main cause 
of the restriction of the inspection speed. 
[0009] Moreover, the present CCD camera's are still 
relatively expensive and heavy. 

[0010] Also plants have a spectral signature and by so 
spectrally splitting up light which is reflected by planted 
soil, the vegetation of this soil and also plants can be 
distinguished from one another. Especially for certain 
wave lengths, the difference in reflectance is large. 
Thus, for example, the difference in reflectance between ss 
earth and a crop is particularly large in the infrared 
range. 

[001 1] The application of this capacity to selectively 



eradicate weeds has already been described in detail. 
By only spraying weed killer there where weeds are 
detected, th weed killer consumption drops signifi- 
cantly, which is not only economical, but in particular 
also less harmful for the environment. 
[0012] Inspection devices have already been 
designed for the selective spraying of weed killers on 
weed which are based on differences in spectral reflect- 
ance characteristics. 

[001 3] The reason is that these devices are too slow 
and/or have too little spacial resolution or also are too 
large, too heavy or too vulnerable to be applied on the 
spraying booms of a spraying device which is moved 
over the crops. 

[0014] The present invention aims an inspection 
device which avoids the above-mentioned and other 
disadvantages and which allows for a relatively fast 
inspection, and which can be made relatively economi- 
cal and quite compact and light. 
[001 5] This aim is reached according to the invention 
in that the image recorder is of the type which can read 
out tines or parts of lines separately. 
[0016] In particular, this image recorder is a CMOS 
image recorder. 

[001 7] A CMOS image recorder is an image recorder 
whose integrated circuits make use of the CMOS tech- 
nology (Complementary Metal Oxide Semiconductor), 
as a result of which the power consumption and heat 
development are very low. 

[0018] What is particularly important is the fact that 
such an image recorder is capable of reading out one or 
several lines with pixels or parts of these lines sepa- 
rately from the image, so that the useful information can 
be transmitted to the processor considerably faster than 
when all the lines have to be transmitted first. 
[0019] The means for spectrally splitting out the 
reflected or transmitted light may here also consist of a 
spectrograph. 

[0020] In order to better explain the characteristics of 
the invention, the following preferred embodiment of an 
inspection device according to the invention is repre- 
sented as an example only without being limitative in 
any way, with reference to the accompanying drawings, 
in which: 

figure 1 schematically represents an inspection 
device according to the invention; 
figure 2 schematically represents another embodi- 
ment of an inspection device according to the 
invention. 

[0021] The inspection device as represented in figure 
1 mainly consists of a spectrograph which is composed 
of an imaging spectrograph 1 forming means for spec- 
trally splitting up reflected or transmitted light and a 
CMOS image recorder 2 working in conjunction with it 
on the one hand, and a processor 3 for processing the 
signals from the CMOS image recorder 2, coupled to 
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this CMOS image recorder 2. 
[0022] The spectrograph 1 consists for example ol a 
front 4 with a narrow slot 5, a front optical system 6 or 
collimator, a diffracting element 7 formed by a diffraction 
grating and a rear optical system 8. 
[0023] A suitable spectrograph 1 is for example mar- 
keted under the name "Imspector" by the company 
SPECIM. 

[0024] The front 4 with the slot 5 may be preceded by 
an objective 9 whose image area coincides with the slot 
5. 

[0025] The optical axes of the optical systems 6 and 8 
may form an angle. 

[0026] The CMOS image recorder 2 or imager is a 
chip which is erected opposite the rear optical system 8. 
[0027] The CMOS image recorder 2 is a non-integrat- 
ing sensor, which implies that one does not have to wait 
for an integration time for reading out, and it is capable 
of reading out lines with pixels or parts thereof, coincid- 
ing with different wave lengths, separately instead of the 
entire image which is for example composed of 512 on 
512 pixels. 

[0028] In fact, it is of the type of what is called "with 
truly random read-out capabilities", in other words it is 
capable of reading out the value of each individual pixel 
separately by selecting the X and Y read-out lines. 
[0029] Naturally, it can also separately read out sev- 
eral pixels forming a line or a part thereof upon request 
of the processor 3. 

[0030] A suitable CMOS image recorder 2 is the 
CMOS camera which is sold under the brand name 
"Fuga 15c M by the company CCAM Technologies N.V 
[0031 ] The spectral sensitivity of such a camera type 
is situated between 400 and 1050 nm, which is compa- 
rable to the sensitivity of a CCD camera. 
[0032] The CMOS image recorder 2, as well as the 
above-mentioned "Fuga 15c" camera, may contain a 
built-in analog-to-digital converter, so that an external 
image reception card is not required. 
[0033] The processor 3 has the required logic to proc- 
ess the signals of the image recorder 2. It may contain a 
comparator which compares the signals of the CMOS 
image recorder 2 with standards stored in its memory 
and/or an arithmetic unit calculating a classification 
algorithm. 

[0034] This processor 3 may be entirely or partly inte- 
grated in the CMOS chip, so that the device can be 
made even more compact and lighter. 
[0035] The reflected or transmitted light may be the 
daylight According to a variant, the inspection device 
contains a light source, however, for example a halogen 
lamp, which exposes the surface to be inspected 
together with or in the place of the daylight. A light 
source also makes it possible to detect in the dark or to 
reduce the dependence of variations in the daylight. 
[0036] The working of the above-described inspection 
device is simple and as follows: 
[0037] By means of the objective 9, the light which is 



reflected by a part of the surface to be inspected or 
which is transmitted through this surface is projected on 
the slot 5 in the front 4. 

[0038] Through this slot 5, a part of this reflected or 
5 transmitted light which coincides with the reflected or 
transmitted light of a strip of the surface is extracted. 
[0039] The front optical system 6 collimates this light 
entering through the slot 5 which is then further split up 
in its spectral components by the diffracting element 7, 
10 i.e. according to its wavelength. 

[0040] The figure represents only three such wave- 
lengths, but in reality there are much more of them. Nat- 
urally, the number of wavelengths is adapted to the 
CMOS image recorder 2. 
75 [0041 ] By the rear optical system 8 is formed an image 
of this diffracted light which is finally projected on the 
CMOS image recorder 2. 

[0042] As the optical axes of the optical systems 6 and 
8 form an angle, only diffracted light of the first order will 

20 reach the CMOS image recorder. This erection also 
reduces the angle between the incident light and the 
optical axis of the second optical system, as a result of 
which aberrations in the imaging are reduced. 
[0043] By adding extra components such as for exam- 

25 pie a prism to the spectrograph 1, these optical axes 
could be placed in line as in the above-mentioned spec- 
trograph 1 which is marketed by the company SPECIM. 
[0044] The spectrograph 1 does not contain any mov- 
ing parts, it is relatively robust and it can give the entire 

30 spectral image of the inspected strip as a whole. 

[0045] One of the axes of this CMOS image recorder 
2, the vertical axis in the figure, coincides with a spectral 
axis, whereas the other axis coincides with a spacial 
axis. 

35 [0046] On this image recorder 2, a number of images 
of the strip are each time formed for a different fre- 
quency, in the example represented on top of one 
another. 

[0047] Instead of having to read all the information, i.e. 

40 all the lines coinciding with the wave lengths, and hav- 
ing to send information related to it to the processor 3, 
the CMOS image recorder 2 only reads those images 
and thus those lines or wave lengths which are typical, 
and which are thus required for further processing. 

45 [0048] This reading out of one or a limited number of 
wave lengths and the transmission of the coinciding 
information to the processor 3 naturally goes much 
faster then when all the lines have to be read out. 
[0049] In practice, usually about ten random lines or 

so images with different wave lengths are required, which 
is for example 50 times less than with a CCD camera 
(charge coupled device) for the same number of lines 
and pixels per line, so that for this case the reading out 
can be carried out 50 times faster. 

55 [0050] However, this large speed increase does not 
raise the cost price. On the contrary, according to the 
present market prices, a CMOS image recorder is 
cheaper than a CCD camera. 
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[0051] It is even possible to read only part of the 
selected lines. For example, if only a part of the strip 
whose reflected or transmitted light falls in the spec- 
trograph 1 needs to be inspected, only the coinciding 
part of the selected lines or wave lengths should be 
read. 

[0052] In an extreme case, only one pixel or a very 
restricted number of pixels of each selected line can be 
read. In this case, the spacial component is omitted and 
only the spectral component is preserved, so that no 
strip but a spot or patch of the surface to be inspected is 
inspected. 

[0053] In this case, it is not necessary to use a CMOS 

image recorder 2 with for example a square surface, but 

a linear CMOS image recorder 2 will da 

[0054] It is also possible to switch lines very quickly, 

and to thus select other or additional lines or wave 

lengths. 

[0055] Instead of a spectrograph 1 , other means can 
be used to obtain a spectral decomposition of the 
reflected or transmitted light. Thus, the spectral decom- 
position can be obtained by means of an optical diffrac- 
tion element, rotating disc with filters, etc. 
[0056] Figure 2 represents an embodiment which dif- 
fers from the above-described embodiment in that the 
means for obtaining a spectral decomposition contain 
an optical diffraction element formed of a zone plate or 
zone lens 10 instead of a spectrograph. 
[0057] A zone lens is similar to an ordinary lens, save 
that its focal length is inversely proportionate to the 
wave length of the light. In front of this zone lens 10 is 
also erected a front 4 provided with a slot 5, and light of 
one point of the slot 5 is split up in its spectral compo- 
nents by the zone lens 10. 

[0058] The diffracted light forms a line image on the 
surface of the CMOS image recorder 2, whose surface 
is parallel to the optical axis so as to obtain a correct 
imaging. 

[0059] The above-mentioned line image will not be 
rectangular, but trapezoid, since the focal length and 
thus the enlargement varies according to the wave 
length. For larger wave lengths, such as red and infra- 
red, the focal length is shorter and thus the enlargement 
smaller. 

[0060] According to a variant, an additional lens 1 1 
may be erected between the front 4 and the zone lens 
10 which first colli mates the light before it falls on the 
zone lens 10. In figure 2, such an additional lens 11 is 
represented as a dashed line. 
[0061] The reflected or transmitted light of a narrow 
strip of a surface is each time inspected in the above- 
described manner. By moving the inspection device 
preferably crosswise on this strip in relation to the sur- 
face, or inversely, by moving the surface preferably 
crosswise on this strip in relation to the stationary 
inspection device, the entire material surface may be 
inspected if required. 

[0062] Also, the above-described inspection devices 



may be used in all sorts of applications, in the industrial 
as well as the medical or agrarian sector. 
[0063] A possible application is the inspection of 
objects in the industry, for example inspecting a metal 

s plate in order to detect any possible flaws. These flaws 
will give a different spectral reflectance curve. The proc- 
essor emits a signal when a flaw is detected. 
[0064] In an analogous manner, also textile can be 
inspected in order to detect for example weaving flaws 

10 or colour flaws. 

[0065] These materials to be inspected can be moved 
past the stationary inspection device at a high speed. 
[0066] The device can also be used for sorting or clas- 
sifying objects or goods. 

75 [0067] Another interesting application of the inspec- 
tion device is inspecting the soil with vegetation. 
[0068] With this device, it is not only possible to distin- 
guish vegetation from soil, but also different plants, and 
consequently for example weeds from crops. 

20 [0069] Differences in the reflectance of the plants in 
the visible wave length scope are mainly due to their 
chlorophyll production, whereas differences in the 
reflectance in the near infrared are due to the inner 
structure of the plant. 

25 [0070] The above<Jescribed inspection device may be 
part of a spraying installation which can spray in a 
selective manner (manure, fungicides, herbicides, 
insecticides or other products used in the agricultural 
sector), or it may be part of a system which activates 

30 other locally acting treatments. Thus, it is possible to 
activate the treatment only there where it is required. 
[0071] If the spraying installation is an appliance for 
eradicating weeds, several inspection devices are usu- 
ally applied on the spraying boom, for example one 

35 every three metres, and the CMOS imager 2 of each 
inspection device will only read out those images for the 
wave lengths which make it possible to distinguish one 
or several weed sorts from the soil or crop. The proces- 
sor 3 then makes sure to send a signal to the control of 

40 the spray nozzles every time weed is detected, so that 
weed killer is only sprayed on this weed. 
[0072] In an analogous manner, insecticide, fungicide 
or manure can be selectively sprayed on the crop each 
time the inspection device distinguishes a plant from the 

45 soil. 

[0073] The light response of a CMOS image recorder 
is logarithmic, so that it is easy and inexpensive to take 
the changing ambient light into consideration, which 
may be useful among others in the above-mentioned 

so appliances for the agricultural sector, where parts of the 
surface to be inspected may be strongly exposed by the 
sun, whereas others may be situated in the shadow. 
[0074] The above-described sensors consisting of the 
means to spectrally split up reflected or transmitted light 

55 and the image recorder 2 coupled thereto make it possi- 
ble to obtain data in a very flexible manner and for a 
large number of wave lengths with a relatively good 
spectral and spacial resolution which can then be fur- 
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ther processed by the processor 3. 
[0075] The invention is by no means limited to the 
embodiments described above and represented in the 
accompanying drawing; on the contrary, such an 
inspection device can be made in all sorts of variants 
while still remaining within the scope of the invention. 

Claims 

1. Inspection device containing means to spectrally 
split up reflected light or transmitted light, an image 
recorder (2) coupled thereto and a processor (3) 
connected to the image recorder (2) for processing 
its signals, characterized in that the image recorder 
(2) is of the type which can read out lines or parts of 
lines separately. 

2. Inspection device according to claim 1, character- 
ized in that the image recorder (2) is a CMOS 
image recorder. 

3. Inspection device according to claim 1 or 2, charac- 
terized in that the means for spectrally splitting up 
the reflected or transmitted light contain a spec- 
trograph (1). 

4. Inspection device according to claim 3, character- 
ized in that the spectrograph (1) contains a front 
optical system (6), a diffracting element (7) and a 
rear optical system (8), whereby the optical axes of 
the two optical systems (6 and 8) form an angle. 

5. Inspection device according to claim 1 or 2 t charac- 
terized in that the means for spectrally splitting up 
reflected or transmitted light contain a diffracting 
optical element. 

6. Inspection device according to claim 5, character- 
ized in that the diffracting optical element is a zone 
lens (10). 

7. Inspection device according to claim 4 or 5, charac- 
terized in that the zone lens (10) is preceded by a 
lens (11). 

8. Inspection device according to any of the preceding 
claims, characterized in that the means for spec- 
trally splitting up the reflected or transmitted light 
contain a front (4) at the front side, provided with a 
narrow slot (5). 

9. Inspection device according to claim 8, character- 
ized in that it contains a lens (9) in front of the front 
(4). 

10. Inspecti n device according to any of the preceding 
claims, characterized in that it is part of a spraying 
installation for plants, whereby it distinguishes 



plants from one another and whereby it is coupled 
to a spraying system, for example for selectively 
spraying w ed killer. 

5 11. Inspection device according to any of claims 1 to 9, 
characterized in that it is part of a device for detect- 
ing flaws or such in materials. 

12. Inspection device according to any of claims 1 to 9, 
10 characterized in that it is part of a device for classi- 
fying objects or materials. 
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